Large Language Models (LLMs) have achieved remarkable success in many formal language oriented tasks, such as structural data-to-text and semantic parsing. However current benchmarks mostly follow the data distribution of the pre-training data of LLMs. Therefore, a natural question rises that do LLMs really understand the structured semantics of formal languages. In this paper, we investigate this problem on a special case, converse binary relation. We introduce a new benchmark ConvRe focusing on converse relations, which contains 17 relations and 1240 triples extracted from popular knowledge graph completion datasets. Our ConvRE features two tasks, Re2Text and Text2Re, which are formulated as multi-choice question answering to evaluate LLMs' ability to determine the matching between relations and associated text. For the evaluation protocol, apart from different prompting methods, we further introduce variants to the test text and few-shot example text. We conduct experiments on three popular LLM families and have observed various scaling trends. The results suggest that LLMs often resort to shortcut learning and still face challenges on our proposed benchmark.

Bluestack Strategies founder and Principal Maura Gillespie and former Manchin Communications Director Jonathan Kott discuss the 2024 presidential primaries, the growing list of Republican candidates and voter concerns over President Biden's age. The Donald Trump and Ron DeSantis camps are trading blows after the Florida governor's 2024 campaign debuted an AI-generated image depicting the former president hugging Dr. Anthony Fauci. It's also further fueling concerns about how AI "deepfakes" of altered video, photos or audio portraying candidates saying and doing things they did not could affect the 2024 campaign. This stunt had the'please clap' energy of Ron DeSanctimonious' mentor, Jeb Bush," a Trump campaign adviser told Fox News Digital of the images. One of Trump's most vocal allies in the Senate, freshman Sen. JD Vance, R-Ohio, tweeted on Thursday, "Smearing Donald Trump with fake AI images is completely unacceptable.

DOCTOR IN THE HOUSE: Former White House doctor and current Rep. Ronny Jackson said Biden's'lack of physical ability and his physical decline' highlight his'cognitive decline'… Read more: Former doctor for Trump, Obama slams White House's'malpractice' in allowing Biden to seek re-election TOPSHOT - US President Joe Biden is helped up after falling during the graduation ceremony at the United States Air Force Academy, just north of Colorado Springs in El Paso County, Colorado, on June 1, 2023. FLASHBACK: Many recalled how Biden during the 2020 campaign poked fun at former President Trump's apparent tottering down a ramp… Read more: Biden, who just fell on stage, once mocked Trump for carefully walking down ramp at commencement THE TRUTH IS OUT THERE: The US government has vessels and parts of craft of "exotic origin" (potentially not human-made), according to a recently-revealed whistleblower… Read more: Military whistleblower goes public with claims US has secret UFO retrieval ...

After 38 years as the head of the National Institute of Allergy and Infectious Diseases, Dr. Anthony Fauci announced on Monday that he will be stepping down from his role in December. Appointed to the position in 1984 by then-president Ronald Reagan, Fauci has personally overseen the federal government's response to some of the 20th century's deadliest infectious diseases -- from tuberculosis and COVID to SARS and MERS. But, as he told The Guardian in 2020, "my career and my identity has really been defined by HIV." The prevention and treatment of HIV has been a prioritized area of research for the NIAID since 1986, and one that Dr. Fauci has devoted much of his public service to. The current state of AIDS research and response in America is thanks in no small part to his continued efforts in the field.